2 links tagged with all of: inference + tiered goals + tournament sampling
Click any tag below to further narrow down your results
Links
Sean Goedecke explains how to build real-time AI systems using "System One" models—fast classifiers that pick from multiple-choice options instead of generating arbitrary text. He shares two practical techniques: tiered goals (breaking decisions into hierarchical loops) and tournament sampling (narrowing large option sets through multiple passes).
- You can convert any LLM into a fast classifier by batching single-token outputs with structured choices, getting predictable inference timing without retraining the model
- Tiered goal hierarchies (strategic → tactical → specific targets) let System One models handle complex tasks like game-playing by providing short-term context, similar to how LLM reasoning chains work
- Tournament sampling outperforms absolute scoring for large option sets—the Wikiracing demo found the optimal 3-link Wikipedia path by sampling 100 links at a time rather than trying to rank all 1,000+ options at once
The author demonstrates two practical techniques for programming with System One models (fast classifiers that pick from multiple choices): tiered goal-setting for sequential decision-making, and tournament sampling for choosing among many options. He shows these approaches working in Doom gameplay and Wikipedia navigation tasks.
- Tiered goals work better than single-pass decisions: periodic prompts asking the model to choose short-term goals (e.g., "kill enemies" vs "collect armor") make it perform more intelligently than just reacting to immediate game state every 200ms.
- Tournament sampling beats confidence scoring when picking from many options: feeding 100 links at a time, then narrowing down, found the optimal path in seconds, while trying to score all 1,000+ links failed badly.
- System One models offer a practical alternative to tool calls for real-time systems where you need predictable latency and don't need full language generation flexibility.